Evaluating Performance of Distributed Systems With MapReduce and Network Traffic Analysis
نویسندگان
چکیده
Testing, monitoring and evaluation of distributed systems at runtime is a difficult effort, due the dynamicity of the environment, the large amount of data exchanged between the nodes and the difficulty of reproduce an error for debugging. Application traffic analysis is a method to evaluate distributed systems, but the ability to analyze large amount of data is a challenge. This paper proposes and evaluates the use of MapReduce programming model to deep packet inspection the application traffic of distributed systems, evaluating the effectiveness and the processing capacity of the MapReduce programming model for deep packet inspection of a JXTA distributed storage application, in order to measure performance indicators. Keywords-Measurement of Distributed Systems; MapReduce; Network Traffic Analysis; Deep Packet Inspection.
منابع مشابه
Communication-Aware Traffic Stream Optimization for Virtual Machine Placement in Cloud Datacenters with VL2 Topology
By pervasiveness of cloud computing, a colossal amount of applications from gigantic organizations increasingly tend to rely on cloud services. These demands caused a great number of applications in form of couple of virtual machines (VMs) requests to be executed on data centers’ servers. Some of applications are as big as not possible to be processed upon a single VM. Also, there exists severa...
متن کاملEvaluating Subunits Importance in Performance Measurement of Network Systems in Data Envelopment Analysis
In conventional DEA models, decision making units (DMUs) are generally assumed as a black-box while the performance of decision making sub-units (DMSUs) and their importance play crucial roles in analyzing the performance of systems which have internal processes. The present paper introduces an ideal network which have efficient processes and next purposes a new approach for evaluating importa...
متن کاملAdaptive Dynamic Data Placement Algorithm for Hadoop in Heterogeneous Environments
Hadoop MapReduce framework is an important distributed processing model for large-scale data intensive applications. The current Hadoop and the existing Hadoop distributed file system’s rack-aware data placement strategy in MapReduce in the homogeneous Hadoop cluster assume that each node in a cluster has the same computing capacity and a same workload is assigned to each node. Default Hadoop d...
متن کاملPerformance Guarantees for Distributed Reachability Queries
In the real world a graph is often fragmented and distributed across different sites. This highlights the need for evaluating queries on distributed graphs. This paper proposes distributed evaluation algorithms for three classes of queries: reachability for determining whether one node can reach another, bounded reachability for deciding whether there exists a path of a bounded length between a...
متن کاملBalancing the Load to Reduce Network Traffic in Private Cloud
Infrastructure-As-A-Service (IAAS) provides an environmental setup under anyone type of cloud. In Distributed file system (DFS), nodes simultaneously serve computing and storage functions; that is parallel Data processing and storage in cloud. Here, file is considered as a data. That file is partitioned into a number of chunks allocated in distinct nodes so that MapReduce tasks can be performed...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012